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Abstract 

The aim of this work is to study some lattice diagram polynomials 
Ad{X,Y) as defined in [4] and to extend results of [3|. We recall that 
Md denotes the space of all partial derivatives of Ad- In this paper, 
we want to study the space Mij {X, Y) which is the sum of AId spaces 
where the lattice diagrams D are obtained by removing k cells from a 
given partition, these cells being in the "shadow" of a given cell {i,j) of 
the Ferrers diagram. We obtain an upper bound for the dimension of 
the resulting space Mj^j (X, y), that we conjecture to be optimal. These 
upper bounds allow us to construct explicit bases for the subspace M*j(X) 
consisting of elements of F-degree. 

1 Introduction 

Definition 1.1 A lattice diagram is a finite subset o/N x N. For fii > fJ.2 > 
• • • > (Ltfc > 0, we say that /i — (/ii, ^2, • ■ • , Mfc) ^■s a partition of n if n = 
/ii + • • • + /ife. We associate to a partition fi its Ferrers diagram {(i,j) '■ < 
i<k — l,0<j< /ii+i} and we use the symbol /i for both the partition and its 
Ferrers diagram. 

Most definitions and conventions we use are similar to [1]. For example, given 
the partition (4, 2, 1), its partition diagram is 



2,0 








1,0 


1,1 






0,0 


0,1 


0,2 


0,3 



It consists of the lattice cells {(0, 0), (0, 1), (0, 2), (0, 3), (1, 0), (1, 1), (2, 0)}. 
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Definition 1.2 Given a lattice diagram D = {(pi, qi), (p2, 92), ■ • ■ , {Pn, <?«)} we 
define the lattice determinant 

Ac(X;y)=det||a;fyf 11"^.^^, 
where X = X,-, = {xi,X2, ■ ■ .,Xn} and Y ^ ^ {yi,y2, • ■ • ,2/n}- 

The polynomial A]j(X; Y) is bihomogeneous of degree \p\ — Pi + ■ ■ ■ + Pn in X 
and of degree \q\ — Qi + ■ ■ ■ + Qn in Y. To insure that this definition associates 
a unique polynomial to D we require that the list of lattice cells be given with re- 
spect to the following "pseudo-lexicographic" order: {(0, 0), (1, 0), (2, 0), (0, 1), (1, 1), (0, 2), (0, 3)}. 

For a polynomial P{X] Y), the vector space spanned by all the partial deriva- 
tives of P of all orders is denoted Cq [P] . A permutation a G 5„ acts diagonally 
on a polynomial as follows: aP{X;Y) = P{x^^,Xcy2, ■ ■ ■ ,Xa„]yai,ya2, ■ ■ ■ ,y<7„)- 

Under this action, A]:){X;Y) is clearly an alternant. It follows that for any 
lattice diagram D with n cells, the vector space Md — Cg[A]:){X;Y)] is an 
iS„-module. Since Ad{X;Y) is bihomogeneous, this module affords a natural 
bigrading. 

The most general problem exposed in and [S] concerns the space Mo- 
The main question is to decide whether this space is iS„ -isomorphic to a sum of 
left regular representations or not. In the particular case where D corresponds 
to a partition /x the question leads to the "n! conjecture" which asserts that the 
space Mfj, is a single copy of the left regular representation. Many efforts to 
prove this conjecture were only sufficient to obtain it in some special cases (see 
[Hi [2] ; H , [H] for example) . In [S] , the case where all the lattice cells of D lies 
on a single axis is solved. 

The next class of lattice diagrams that is of interest is obtained by removing a 
single cell from a partition diagram. Its interest comes in part from the fact that 
it gives a possible recursive approach for the n! conjecture. If is a partition of 
n-l- 1, we denote by ii/ij the lattice diagram obtained by removing the cell {i,j) 
from the Ferrers diagram of We refer to the cell {i,j) as the hole of fi/ij. It 
is conjectured in [J] that the number of copies of the left regular representations 
in M^jij is equal to the cardinality (which we denote by s) of the {i, j)- shadow, 
that is the cardinality of {(«', j') & ■ i' > i, j' > j}- 

A study of the subspace M^^^j^X) of M^/^ consisting of elements of Y- 
degree can be found in [3] , in which the corresponding "four term recursion" is 
proved by using the construction of explicit bases. 

Here we study the following problem. Let /i be a partition of Ji + k. This 
partition is fixed and does not appear in the following notations. 

Definition 1.3 Let M^^ denote the following sum of vector spaces 
Mlj(X,Y)= ^ M^/{(Qi,bi),...,(Qj,,bfc)}, 

(ai,f)i),...,(ai.,f)fc) 

where the sum is over all the k-tuples of cells in the shadow of {i,j). 
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Because of the "shift" operators (see [3], Proposition 1.3 or section 2 in this 
paper) we have M^/ij = Mjy Hence this space M^^ is a possible generahzation 
of M^/ij if we want to make k holes in the Ferrers diagram. That is precisely 
this space that we want to study. In fact we obtain an upper bound for the 
dimension of this object, that we conjecture to be optimal. 

In the second section we introduce some "shift" operators which are useful 
to move the holes and the cells in the diagrams. The third section is devoted to 
the proof of an upper bound for the dimension of M^j that is conjectured to be 
optimal. In the fourth section we study M^j{X), the subspace of M*^^(X, F) 
consisting of elements of y-degree, for which wc obtain explicit bases. 

2 The "shift" operators 

For the sake of simplicity, we only settle the following propositions for X-shifts. 
Of course similar results also hold for F-shifts. 

Proposition 2.1 Let L be a lattice diagram. Then for any integer k > I we 
have 

n 

Pk{dX)AL{XX) = 5]e(pfc(*;i))Ap,(,,i)(X,y) 

1=1 

where pk{i,L) is obtained by replacing the i-th biexponent Pi,qi by pi — k,qi 
and the coefficient e{pk{i', L)) is different from zero only if the resulting dia- 
gram consists of n distinct cells in the positive quadrant. Its sign is the sign 
of the permutation that reorders the obtained biexponents in increasing pseudo- 
lexicographic order. 

Proof 1 This is a particular case of Proposition I.l in J^. 

Remark 1. The diagram pk{i,L) is the diagram obtained by pushing down 
the i-th cell of L: its biexponent (p;, qi) is replaced by {pi — k, qi) which corre- 
sponds to k steps down. The other biexponents are unchanged. This duality 
between the substractions on the set of biexponents and movements of cells 
of the diagram will be extensively employed all along this article, explicitly or 
implicitly. 

Proposition 2.2 Let L be a lattice diagram. Then for any integer k > 1 we 
have 

ekidX)ALiX,Y) ^ J2 e(efc(ii,...,Zfe;L))A,,(,,^...,,,;i)(X,y) 

l<il<i2<---<jfc<n 

where ek(ii, . . . ,ik', L) is obtained by replacing the biexponents {pi-^ , ), . . . , (pi^. , qi^, ) 
by (Ki -1, • • ■ , (Pife -1, Qik) fl"*^ where the coefficient e(efe(ii, . . . , ik] L)) is a 
nonnegative integer which is different from zero only when the resulting diagram 
consists of n distinct cells in the positive quadrant. 
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Proof 2 The proof is almost the same as for the previous proposition. We write 

l<ji<---<jk<n 

We develop the determinantal form of Aj^ with respect to the columns ji, . . . , 7 
to obtain the following expression where denotes the lattice diagram 

polynomial relative to the biexponents ii,...,ik of L and Ai^^,,,^i^^.j^^,,,j^ the 
cofactor: 

Al{X) = ^ A^^' ' '"{xj^, . . . ,Xj^)Ai^^,,,^i^.j^^,,,j^. 

l<ii<---<ik<n 

Next we derive to obtain 

d{Xj^ . . . Xj^)AL{X) = ^ i^ii,---,ik;ji,--;jk^ekiii,'^.;ik;L)(-'^h' ■ ■ ■ ^^jk) 

l<ii<---<ik<n 

X Aii,...,ih;ji,...,jk)'> 

where Cij,..._i^;jj j^. is a nonnegative integer. In fact Ci-^ ik:ji....,jk appears to 

be independent ofji, . . . ,jk; therefore we can omit the subscript ji, . . . ,jk. Thus 
we get 

l<ii<---<ik<n l<ji<---<jk<n 

X -Ai:^^,...,ik;ji,...,jk)- 

By recognizing the developpement o/Ag^(j^ j^^.^), we finally obtain the expected 
formula. The sign of the coefficient e{ek{ii, . . . ,ik', L)) is the sign of the permu- 
tation that reorders the obtained biexponents in increasing pseudo-lexicographic 
order; in fact with the choice of the order this permutation is always the identity. 

Let D he a, lattice diagram. Let us denote by D' its complementary in the 
positive quadrant (it is an infinite subset). We take the convention that for any 
diagram D, Ajji = Ajj (the prime name D' will denote the complementary of 

a lattice diagram D). 

Proposition 2.3 With the previous notations, for any lattice diagram L and 
for any integer k > 1, we have 

hk{dX)ALiX,Y) = Y <hk{ii,...,ik,L'))Af,,^i,,...,i„L'){X,Y) 

ii<i2<---<ik 

where hk{ii, . . . ,ik, L') is obtained by replacing the biexponents (pi-^ ,qi-^),..., {pi,^ , gj^.) 
of L' by {pi^-\-l,qi^),. . . ,{pi^ + l,qi,) and the coefficient €{hk{ii, ... ,ik,L')) is 
a nonnegative integer which is different from zero only when the resulting L' 
consists of distinct cells in the positive quadrant. 
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Proof 3 We shall prove this proposition by induction on k. If k ~ I, then 
hi = ei and the result is true since moving down a cell is equivalent to moving 
up a hole. Assume the result is true up to k — 1. Then we use the fact that 

hk = hk-ici ~ hk-2e2 H h {~l)''hiek-i + (-l)''+^efe. Indeed h^-i pushes up 

(k — 1) different holes. And ei moves down one cell, that is pushes up a hole. 
But if this hole has already been pushed up by hk-i, we can view this situation 
as k — 2 holes which have made one "step " and one which has made two steps. 
But this situation is killed by the term —hk-2e2- Thus by looking successively 
at the terms in the previous formula for hk, we get what we want. 

Remark 2. One efficient application of Proposition 12.31 is to give immediate 
proofs of Propositions 1-2-3-4 of [5] (these propositions provide a Groebner 
basis of the annulator ideal of A/i when /i is a hook. The previous proofs 
were recursive and intricate but the results now become simple applications of 
Proposition 12.31 

Remark 3. In the particular case of two holes, we obtain 

efe_i(X)p;(r)((9)A^/{(,j)_(i+ij)} = ciA^/{(i^j)^(,+fcj+,)} +C2A^/{(,;+;j)^(jj+fe)}, 

e;_i(y)pfe(X)(a)A^/{(jj)^(i^j+i)} = c3A^/{(,j)^(j+j.j+,)} + c4A^/{(i+,^j)_(ij+fe)} 

where Ci, C2, C3, C4 are rational constants such that ci and C2 are of the same 
sign and C3 and C4 are of opposite sign. 

By Proposition 12 . 31 we can move simultaneously the two holes. This implies 
that for any couple of holes (/ii,/i2) in the shadow of {i,j) then A^/^/i^ /j^j. G 
Mf,/{(i,j).Xi,j+i)} thus 

The question of the generalization of the previous result when k > 3 appears 
spontaneously. Is it sufficient to take only the diagrams such that the holes form 
a partition of origin {i,j) ? The answer is negative. For example it is easy to 
check that when /i = (3, 2) 

Ap/{(0.0),(1:0),(0.2)} ^ Af/./{(0,0),(1.0),(0a)} +^'-^M/{(0,0).(0,l):(0,2)}• 
3 The upper bound 

We define the annulator ideal of a vector subspace M of Q[Xn, Yn] as the fol- 
lowing ideal: Im = {P e Q[X„,y„] : VQ € M, P{d)Q = 0}. If M = £a[P] 
then we denote its annulator ideal simply by Ip. In the case of M^j we denote 
Im^ ^ by J^. 

We recall the following important result ([7], Proposition 1.1): M — ij^, 
where the scalar product is defined by {P, Q) = Lo{P{d)Q) and where Lq is the 
linear form that associates to a polynomial its term of degree 0. 



5 



3.1 About ideals 



We want here to prove the following 
Proposition 3.1 

(ai,6i),...,(afc,6fc) 

where the sum is over the k-tuples of different cells in the shadow of {i,j) that 
we assume to be ordered in lexicographic order. 

Proof 4 By expanding with respect to the last k columns, we obtain: 

Ap(X„+fe, Fn+fc) = ^ ± ^{(aubi),....{ak,bk)}{Xn+l, ■ ■ ■ ,Xn+k,yn + l, ■ ■ ■ , Un+k) 

(ai,bi),...,(afc,bfc) 

X ^tJ./{(aiM)....,{akM)}i^n, Yn). 

Thus for example: 

where c is a rational constant (different from 0) and C a linear combination with 

coefficients m (Q)[a;„+i, ?;„+i, . . . ^Xn+k^Vn+k] of /^^/ {i^a{,b'i),---,(a'k,K)}^^^^^^) 
{a'j,b'j) in the shadow of {aj,hj). 

Hence we get what we want because: 

• I C I^j follows from what precedes by looking at the constant term in 

Q[Xn+l,yn+l, ■ ■ ■ ,Xn+k, Vn+k]; 

• C I follows directly from what precedes. 

3.2 Orbits 

The reasonning is inspired from [3], Theorem 4.2. 

We consider two families a = (ai, . . . , ah) and /3 = . . . , To any 
injective tableau T of shape fi with entries 1, . . . ,n + fc, we associate a point 
(a(T),6(T)) in C^" by the classical process, ie: ai{T) — ari(T): bi{T) — Pair) 
where ^^(r) (resp. Ci{T)) is the number of the row (resp. column) of T where 
the entry i lies in T. We define p as the orbit of (a, b) when T varies over the 
(n + k)l injective tableaux of shape fi. We introduce Jp the ideal of polynomials 
that are zero all over the orbit, and / —grJp and H = (we recall that gr is 
an operator that associate to a polynomial its term of maximum degree) . It is 
now a classical result (cf [7], Theorem 1.1) that / C /a ■ 

We now look at another orbit in C^". We consider the set of tableaux Tof 
shape with n entries and fc white cells such that the fc white cells are in the 
shadow of («,j) (we denote this set of tableaux by ^^j). By the same process 
as described above, we define an orbit in C^". Since the cardinality of T^^^ is 
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{l)n\ the orbit p'^ has this cardinahty. We introduce Jpk the ideal of polynomials 
that are zero all over the orbit, and l'^ =gr Jpk and H'' = [I^]^ ■ We have of 
course d\mH^ = {^^n\. 

We want to prove that M^- C and by 7J, Proposition 1.1, it is equivalent 
to prove that C I. 

3.3 Inclusion 

We want here to obtain the next proposition: 
Proposition 3.2 We have the inclusion: 

C I. 

Proof 5 Let P he a polynomial in Jpk . Let us consider 

i i j j 

Q{Xn+k,Yn+k) = P{Xn,Yn) J]^ (a;„+i -Qf^' ) • ■ • J]^ (a;„+fe -tti' ) Y]_{yn+i-aj') ■ ■ ■ (y„+fe-aj'). 

i' — 1 i' — 1 j' — ^ i' — 1 

We want to check that this polynomial is an element of Jp. We take an 
element {a, (3) of p. Lf its projection on C^" is in then Q{a,(3) = because 
of P. Lf not it must have at least one entry between n + 1 and n + k in the 
first i rows or the first j columns and we have still Q{a, (3) = 0. Thus gr(P) G 

For any set ofk cells {(ai, . . . , (ofe, bk)} in the shadow of{i,j), we observe 
that V/i, l<h<k, ah>i and hh > j- Hence gr{P) is in I, which was to be 
proved. 

3.4 Conclusion 

The main result is now a consequence of all what precedes: 

Theorem 3.1 Lf p, is a partition of n + k and s the cardinal of the shadow of 
the cell {i,i), then we have: 

Remark 4. Recall the proof of Theorem 1.1 of [7]: the previous reasonning 
implies that if equality holds in Theorem l3.H then ^ decomposes as (^) times 
the left regular representation. 

Numerical examples and the fact that the construction described in the 
previous subsection affords the "good" upper bound in the case of one set of 
variables (see the next section) support the following conjecture. 
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Conjecture 1. (F. Bergeron) With the notations of the previous theorem: 

dimM*;^ 

Remark 5. When k ^ 1, this conjecture reduces to Conjecture 1.2 of ^ and 
when s = fc or A: = to the n\ conjecture. 

4 Case of one set of variables 

The goal of this section is to obtain an exphcit basis for Mj'j (X), ie the subspace 
of Mf^j{X,Y) consisting of elements of F-degree. 

4.1 Construction 

We recall that in [5] is constructed a basis for made of monomial derivatives 
Ms(9)A^ of A^, where the objects S varies over a set S{^) which depends on 
/X. The corresponding construction can be found in [5]. The cardinality of 5(/Lt) 
is equal to n\/fi\ where /i! — /ii!/i2! • ■ ■ l^k- This cardinality is the number of 
injective, row-increasing tableaux of shape /i. 

Then we choose in the Ferrers diagram fi k cells which are simultaneously 
in the shadow of (i, j) and on the right edges of fi. We denote by JT^ the set of 
these objects. In the next figure, the chosen cells are cells with a circle and in 
the cell {i,j) appears a + sign. In this example n = 142 and k ~ 10. 
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Then to an object F in we associate fip the partition of n obtained by 
pushing up the circled cehs and by removing the corresponding cells. We also 
define a partition with k holes as follows. Wc look at the circled cells from 
the right to the left and from bottom to top. For a circled cell in column j' > j 
such that there are I possible places where this circle could have been placed in 
the same column and under this one, wc put a hole in the cell (i + The 
following figure illustrates this construction for the previous F (the holes are as 
usual cells with crosses: x). 



Theorem 4.1 With the previous notations 

Bl^iX) = {A/s(5)A^. ; S e F e T^^} 

is a basis for M^j{X). 



4.2 Upper bound 

Definition 4.1 We denote by T^j the set of injective, row-increasing tableaux 
of shape /i with entries 1, . . . ,n (whence each of these tableaux has k white cells) 
such that the k white cells are in the shadow of {i,j)- 

Proposition 4.1 We have the following upper bound for the dimension of M^j(X) : 

Proof 6 Let I^j{X) denote the annulator ideal of the space M^j(X). It is 
classical that by looking at the monomials in Yn on Q[Xn], we obtain I^j{X) = 
I^^nQlXn]. From the ProvositionlSH we deduce that ifj(X) ^ /f^- nQ[X„] = 

j'nQ[x„]. 

We look at the projection of the orbit on C"; it is equivalent to associate 
a point to each tableau in . Let J^^ denote the annulator ideal of this orbit. 

The question is to prove the following inclusion: gr^J^^^) C I^j(X). The ex- 
actly same reasonning as in the case of two alphabets can be applied successfully. 



4.3 Cardinality 

We claim that: 

Proposition 4.2 We have the following equality 

Proof 7 It is sufficient to observe that we do not change the cardinality by 
pushing up the circled cells. We look at the example of the lines 9, 10 and 11 of 
the previous example. 
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We observe that the lengths of the lines before the transformation are 5, 7, 6 
and after the transformation 7, 6, 5. Thus the set of the lengths is unchanged. 
It is easy to see that it is always the case: the operation that pushes the holes 
up only permutes the lengths of the rows. 
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4.4 Independence 

We want here to conclude by proving that 

Proposition 4.3 The family defined in the paragraph Construction is linearly 
independent. Thus in particular equality holds in Proposition \4-l\ 

Proof 8 Assume that we have a non-trivial dependence relation. 

We define the depth of a hole to be the number of cells (different from holes) 
that are above this hole. We look at the k-tuples of the depths of the k holes of 
the jipi {di < d2 < . . . < dk). The crux of the proof is the following result: 

Lemma 4-1 The k-tuples (di, ^2, . . . , dfc) are all distinct. 

Proof 9 We want to prove that the depth of the holes increases from the right 
to the left and from top to bottom, and that two different fip give two different 
k-tuples of depths. We look at the circled cells with respect to this order. We 
look at the next figure where c denotes the number of circled cells in the column 
we consider, m the number of positions under the lowest circled cell where we 
could put a circle ( these cells appear with a square ), I the height of this column 
(we look only at the cells above the i-th row) and l-\-h is the height of the "next" 
column (ie the first on the lefi). 



O 



o 



□ 



The depth of the lowest circled cell is p = I — c — m. The highest depth that 
could be obtained in this column is I — c if m = and I — c — 1 if m > 0. And in 
the next column the lowest depth is (it corresponds to putting a circle at the top 
of the column): l + h~l^c— h + l = l — c. These observations are sufficient 
to conclude the proof of this lemma. 

Then if we have a non-trivial dependence relation, we consider the greatest k- 
tuple of depths with respect to the lexicographic order that appear in this relation 
(relative to an object F°): {d\,dl, . . .,dl). We then apply hkid)'^" .hkid/^-'^" . . . hi{df"~'^°-K 
It kills all the terms but those which come from the single object F'^ . These terms 
give in fact terms in B — {Ms{d).A^^g; S £ Sdipo)}, which are independent 
since B is a basis of Mf? 



11 



Acknowledgement. The author would Hkc to thank Francois Bergeron for 
indicating him this problem and for numerous valuable suggestions. 

References 

[1] E. Allen, The decomposition of a higraded left regular representation of the 
diagonal action of Sn, J- Comb. Theory A, 71 (1995), 97-111. 

[2] J.-C. Aval, Monomial bases related to the nl conjecture, to appear in Discrete 
Mathematics. 

[3] J.-C. Aval, F. Bergeron and N. Bergeron, On certain spaces of quasi-harmonic 
polynomials, in preparation. 

[4] F. Bor goron, N. Bergeron, A. Garsia, M. Haiman and G. Tesler, Lattice Diagram 
Polynomials and Extended Fieri Rules, Adv. Math., 142 (1999), 244-334. 

[5] F. Bergeron, A. Garsia and G. Tesler, Multiple Left Regular Representations 
Associated with Alternants of the Symmetric Group, in preparation. 

[6] N. Bergeron and A. Garsia, On certain spaces of harmonic polynomials. Con- 
temp. Math, 138 (1992), 51-86. 

[7] A. Garsia and M. Haiman, Some natural higraded Sn-modules and q, t-Kostka 
coefficients, Elec. J. Combin. 3, No 2 (1996) [Paper 24, 60 pp.]. 

[8] A. Garsia and M. Haiman, Orbit Harmonics and Graded Representations, to 
appear in Les editions du Lacim. 



12 



